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Abstract 

For  decades,  the  memory  hierarchy  access  gap  has  plagued  computer  architects  with  the  RAM/disk 
gap  widening  to  about  6  orders  of  magnitude  in  1999.  However,  an  exciting  new  storage  tech¬ 
nology  based  on  Micro  Electro  Mechanical  Systems  (MEMS)  is  poised  to  fill  a  large  portion  of  this 
performance  gap,  delivering  significant  performance  improvements  and  enabling  many  new  types 
of  applications.  This  research  explores  the  impact  MEMS-based  storage  will  have  on  computer 
systems.  Working  closely  with  researchers  building  MEMS-based  storage  devices,  we  examine  the 
performance  impact  of  several  design  points.  Results  from  five  different  applications  show  that 
MEMS-based  storage  can  reduce  application  I/O  stall  times  by  80-99%,  with  overall  performance 
improvements  ranging  from  l.lx  to  20x  for  these  applications.  Most  of  these  improvements  re¬ 
sult  from  the  fact  that  average  access  times  for  MEMS-based  storage  are  5  times  faster  than  disks 
(e.g,,  ISms).  Others  result  from  fundamental  differences  in  the  physical  behavior  of  MEMS-based 
storage.  Combined,  these  characteristics  create  numerous  opportunities  for  restructuring  the  stor¬ 
age/memory  hierarchy. 
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1  Introduction 


For  decades,  the  memory  hierarchy  has  suffered  from  significant  access,  bandwidth  and  cost 
gaps  between  processor,  RAM,  and  disk  [12].  Fortunately,  the  processor/RAM  gap  has  been 
mitigated  by  fast  cache  memories  [11].  Unfortunately,  the  RAM/disk  gap  has  remained 
unfilled,  widening  to  6  orders  of  magnitude  in  1999  and  continuing  to  widen  at  about  50% 
per  year.  The  result  is  a  significant  performance  and  scalability  problem  across  a  range  of 
applications,  including  databases,  web  servers,  mail  servers,  program  development  tools,  and 
even  Microsoft  Word  load  times  [4]. 

This  RAM/disk  performance  gap  is  due  directly  to  the  physical  characteristics  of  disk 
drives.  While  disks  continue  to  deliver  capacity  growth  of  over  60%  per  year,  the  physics  of 
a  drive’s  mechanical  positioning  system  limits  disk  access  time  improvements  to  a  modest 
7%  per  year  [11].  EEPROM  offers  a  portable  high-performance  alternative.  However,  EEP- 
ROM’s  per-megabyte  cost  is  2  orders  of  magnitude  higher  than  disk  storage  (see  Figure  1). 

MEMS-based  storage  is  an  exciting  new  technology  that  could  provide  significant  per¬ 
formance  gains  over  current  disk  drive  technology  and  at  costs  much  lower  than  EEPROM 
technology  [10,  2].  Based  on  MEMS  (MicroElectroMechanical  Systems),  this  non-volatile 
storage  technology  merges  magnetic  recording  material  and  thousands  of  recording  heads  to 
provide  storage  capacity  of  1—10  GB  of  data  in  under  1  cm^  area  with  access  times  of  1—3  ms 
and  streaming  bandwidths  of  over  50  Mbytes/second.  Further,  because  MEMS-based  storage 
is  built  using  photolithographic  IC  processes  compatible  with  standard  CMOS,  MEMS-based 
storage  has  costs  significantly  lower  than  DRAM  and  access  times  an  order  of  magnitude 
faster  than  conventional  disks  [10]. 

Another  very  important  aspect  of  MEMS-based  storage  is  its  ability  to  incorporate  both 
storage  and  processing  into  the  same  chip.  Because  MEMS-storage  is  CMOS-based,  it  is 
possible  to  integrate  several  microprocessors  or  hundreds  of  custom  computational  engines 
(e.g.,  MPEG  encode/decode,  cryptography)  directly  with  the  storage  device.  This  integra¬ 
tion  will  significantly  improve  performance,  power  consumption,  and  cost.  More  importantly, 
it  will  lay  the  foundation  for  a  single  computing  brick  [6]  that  contains  processing,  and  both 
nonvolatile  and  volatile  storage. 
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Figure  1:  Predicted  cost  and  latency  for  storage  technologies  in  2005.  MEMS-based 
storage  fills  the  growing  memory  hierarchy  gap  between  RAM  and  disk.  The  grey  boxes  represent 
nonvolatile  storage.  The  EEPROM  box  is  wide  because  of  the  wide  gap  between  read  and  write 
latencies  for  “Flash”  memories.  The  MEMS  box  is  wide  and  tall  because  of  the  many  design 
possibilities  for  this  new  type  of  storage  (see  Section  2). 


Although  MEMS-based  storage  devices  are  still  several  years  away  from  commercializa¬ 
tion,  their  potential  impact  in  reducing  the  memory  gap  makes  them  an  important  technol¬ 
ogy  for  systems  architects’  consideration.  This  work  begins  the  exploration  process,  seeking 
an  initial  understanding  of  how  MEMS-based  storage  can  improve  computer  systems’  per¬ 
formance  and  how  different  MEMS  device  characterictics  can  fundamentally  change  the 
behavior  and  design  of  storage  systems.  Our  results  show  that  MEMS-based  storage  can 
reduce  application  I/O  stall  times  by  over  80—99%  for  a  set  of  five  file  system  and  database 
workloads.  The  resulting  speedups  for  these  applications  range  from  10%  to  20X,  depending 
mainly  on  the  ratio  of  computation  to  I/O. 

To  ensure  that  our  models  of  MEMS-based  storage  accurately  reflect  potential  implemen¬ 
tations,  we  work  closely  with  a  group  of  researchers  who  are  actively  building  MEMS-based 
storage  devices.  This  collaboration  allows  us  to  explore  the  system-level  impact  of  various 
types  of  MEMS-based  storage,  evaluating  which  physical  design  trade-offs  (e.g.,  acceleration 
speed,  velocity,  size,  capacity)  are  most  important  across  a  range  of  applications.  In  turn, 
our  results  feed  back  to  the  MEMS  researchers,  focusing  their  attention  on  design  parameters 
that  significantly  impact  system-level  performance  and  avoiding  optimizations  that  provide 
little  real  benefit. 
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Figure  2:  Prototype  Positioning  System  and  Probe  Tip.  The  CMU  MEMS  research  group 
has  developed  the  prototype  probe  tip  and  positioning  system  shown  above.  Because  the  recording 
material  is  not  perfectly  flat,  the  positioning  system  must  be  able  to  actively  adjust  the  height  of 
the  probe  tips.  The  tips  could  use  one  of  several  recording  schemes,  from  simple  “typewriting”  with 
permanent  magnets,  to  more  complex  GMR  sensing  techniques  found  in  normal  disk  drives. 


The  remainder  of  this  paper  is  organized  as  follows.  Section  2  describes  MEMS-based 
storage,  many  of  the  physical  trade-offs,  and  three  models  we  have  developed  to  explore  the 
design  space.  Section  3  describes  our  performance  model  for  MEMS-based  storage  devices 
and  uses  microbenchmarks  to  analyze  its  basic  performance.  Section  4  presents  results  for  a 
number  of  applications.  Section  5  discusses  more  general  system-level  issues  and  explores  a 
wide  range  of  applications  for  MEMS-based  storage.  Section  6  outlines  our  conclusions  and 
continuing  work. 

2  MEMS-based  storage  devices 

Microelectromechanical  systems  (MEMS)  are  very  small  scale  mechanical  structures — on  the 
order  of  tens  to  thousands  of  micrometers — fabricated  on  the  surface  of  silicon  wafers.  These 
microstructures  are  created  using  the  same  photolithographic  processes  used  in  manufactur¬ 
ing  other  semiconductor  devices.  Certain  MEMS  structures  can  be  made  to  slide,  bend,  or 
deflect  in  response  to  an  electrostatic  or  electromagnetic  force  from  a  nearby  actuator  or 
from  external  forces  in  the  environment.  MEMS-based  microstructures  are  limited  in  mobil¬ 
ity  compared  to  standard  mechanical  systems.  To  illustrate,  it  is  difficult  to  build  durable 
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Figure  3:  An  example  of  the  “moving  media”  model.  In  (a),  we  see  how  the  media  sled  is 
attached  above  the  fixed  tips.  The  sled  can  move  up  to  100  pm  along  the  X  and  V  axes,  allowing 
the  fixed  tips  to  address  30-50%  of  the  total  media  area.  In  (b),  we  see  the  actuators,  the  spring 
suspension,  and  the  media  sled  itself  Anchored  regions  are  shown  in  black  and  the  movable  structure 

is  in  grey. 

microbearings  to  actuate  and  position  rotating  components.  Previous  attempts  at  building 
micromachined  gear  series  have  shown  that  such  devices  lock  up  from  friction  within  a  few 
thousand  revolutions.  However,  alternative  designs  such  as  spring-suspended  masses  which 
translate  in  the  X  and  Y  directions  (instead  of  rotating  in  0)  circumvent  these  frictional 

barriers. 

One  class  of  MEMS-based  storage  system  structures  under  investigation  takes  advan¬ 
tage  of  arrays  of  thousands  of  microscopic  magnetic  probes  each  accessing  a  dense  substrate 
of  magnetic  material  [2,  10].  This  design  offers  several  notable  advantages  over  disk-based 
storage,  including  better  cost,  access  time,  power  dissipation,  mass,  failure  rate  and  shock 
sensitivity.  Further,  there  is  inherent  parallelism  across  the  wide  array  of  read-wnte  tips: 
multiple  tips  may  be  accessed  concurrently  to  increase  throughput,  accesses  may  be  re¬ 
dundant  to  enhance  reliability,  or  completely  independent  accesses  may  occur  in  parallel. 
In  addition,  the  MEMS  fabrication  process  integrates  seamlessly  with  standard  CMOS  pro¬ 
cesses.  This  ease  of  fabrication  opens  the  door  for  mass  manufacturing  true  MEMS-enhanced 
systems-on-a-chip— massively  parallel  manufacturing,  small  per-unit  cost  in  high  volume,  a 
clear  road  map  toward  smaller  processes,  and  large  amounts  of  industry  momentum. 

For  magnetic  probe-based  MEMS  storage  there  are  two  basic  design  types  for  accessing 
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data.  The  first  employs  an  array  of  movable  probe  tips,  each  suspended  on  a  cantilevered 
beam  and  positioned  over  a  fixed  substrate  of  magnetic  media.  The  beam  moves  by  applying 
a  voltage  to  a  set  of  X-deflectors  and  Y-deflectors,  resulting  in  an  electrostatic  force  that 
causes  the  tip  to  move  deterministically  to  different  positions  over  the  media.  This  “fixed 
media”  model  has  access  times  on  the  order  of  tenths  of  milliseconds.  Unfortunately,  each 
tip  addresses  only  about  1%  of  the  magnetic  material  under  each  cantilever.  For  comparison, 
a  conventional  rotating  disk  accesses  about  50%  of  the  available  media. 

A  second  design,  used  in  the  experiments  described  in  this  paper,  significantly  increases 
storage  capacity  by  replacing  the  fixed  media  with  a  movable  sled  over  an  array  of  stationary 
tips.  This  movable  sled  is  capable  of  moving  100  //m  along  the  X  and  Y  axes  (see  Figure  3) 
achieving  30%  media  coverage.  To  read  or  write  data,  the  sled  first  seeks  until  the  requested 
data  is  directly  over  a  set  of  tips  (See  Figure  4).  The  sled  then  moves  at  constant  velocity 
in  the  Y  direction  only,  streaming  data  to  or  from  the  media.  The  movable  sled  is  much 
more  massive  than  individual  cantilevered  tips,  to  the  extent  that  the  movable  sled  model 
operates  at  an  order  of  magnitude  greater  latency  than  the  fixed  media  model. 

2.1  MEMS  device  characteristics 

MEMS-based  storage  devices  have  a  rich  set  of  characteristics.  For  example,  moving  the 
media  sled  to  access  data  creates  the  equivalent  of  a  disk-like  seek  time.  This  includes  the 
time  to  move  the  sled  to  the  correct  starting  position  and  initial  read/write  velocity  for  the 
access,  and  is  bounded  by  the  amount  of  force  available  from  the  sled  actuators  and  the  mass 
of  the  sled.  Another  parameter,  the  media  access  time,  varies  based  on  the  number  of  tips 
active  during  the  media  access,  the  number  of  bits  each  tip  needs  to  process,  and  the  bit 
rate  per  tip.  For  example,  to  read  100  bits,  one  tip  could  read  at  100  kbit/s  while  the  media 
travels  100  bit  widths  (1  ms),  or  four  tips  could  read  at  100  kbit/s  each  while  the  media 
travels  25  bit  widths  (0.25  ms).  There  is  unfortunately  a  limit  to  the  number  of  tips  that 
can  be  simultaneously  active.  Although  specific  numbers  for  power  and  heat  generation  are 
not  known,  we  assume  for  now  values  of  1-3  mW  per  active  tip  and  100  mW  continuous  for 
the  media  positioning  system.  As  we  envision  devices  with  10,000  tips/cm^,  using  all  tips 
simultaneously  results  in  a  power  dissipation  of  10.1—30.1  W/cm^!  For  this  reason  we  limit 
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(c)  Sled  arrives  at  destination. 


(d)  Tips  start  reading  data. 


(e)  Sled  drags  further  past  tips.  (f)  Data  access  complete. 


Figure  4:  Notional  drawing  of  data  access  in  a  MEMS-based  storage  device. 

This  series  of  drawings  shows  the  moving  parts  of  the  sled  system  as  it  accesses  a  region 
of  data,  as  indicated  with  lines.  The  X  and  Y  actuators  pull  the  sled  and  the  springs  flex. 
All  components  shown  in  black  (the  comb  actuators  and  the  spring  anchors)  remain  fixed 
while  the  components  in  grey  (the  sled  and  the  springs)  are  free  to  move.  It  is  important  to 
notice  that  the  tips,  shown  as  small  triangles,  also  remain  stationary,  as  they  are  fixed  to  the 
underlying  chip  (as  in  Figure  3). 


1st  gen. 

2nd  gen. 

3rd  gen. 

bit  width  (nm) 

50 

40 

30 

sled  acceleration  {g) 

11.7 

11.7 

17.6 

access  speed  (kbit/s) 

200 

400 

400 

access  speed  (mm/s) 

10 

16 

12 

resonant  frequency  (Hz) 

220 

220 

330 

post-seek  X  settling  time  (ms) 

1.447 

0.723 

0.482 

maximum  throughput  (MiB/s) 

10.85 

21.70 

54.25 

number  of  sleds 

1 

1 

1 

per-sled  capacity  (GiB) 

2.098 

3.219 

5.880 

bidirectional  access 

no 

yes 

yes 

Table  1:  MEMS  device  parameters  used  in  our  experiments. 


the  number  of  concurrent  tips  in  our  models  (described  below)  to  only  640-3200  tips. 

Given  the  wide  range  of  parameters,  exploring  the  entire  MEMS-based  storage  design 
space  would  take  a  considerable  amount  of  time.  To  reduce  this  effort,  we  constructed 
three  models  of  MEMS-based  storage  based  on  what  we  anticipate  will  be  the  technology 
advances  over  the  first  three  generations.  We  describe  each  model  below  and  summarize  the 
parameters  in  Table  1. 

The  “Ist  generation  (Gl)”  model  represents  the  initial  MEMS  storage  devices,  which 
we  expect  could  be  fabricated  within  the  next  three  years  [10].  Each  sled  will  have  a  full 
range  of  motion  of  100  pm.  along  the  X  and  Y  axes,  and  the  actuators  will  accelerate  the 
sled  at  11.7(7.  To  access  data,  the  device  uses  a  typewriting  method  of  moving  the  probe  tip 
up  and  down  over  every  bit.  This  typewriting  method  is  inefficient  and  limits  read  speed  to 
about  200  kbits/s  per  tip.  This  design  only  offers  unidirectional  accesses;  for  example,  reads 
and  writes  may  occur  only  when  the  sled  is  moving  in  the  positive  Y  direction. 

Under  the  Gl  model  the  tip  resolution  and  sled  positioning  system  provide  a  square  bit 
cell  of  50  nm  sides  such  that  each  tip  addresses  a  2000x2000  array  of  bits.  The  sled  footprint 
is  0.64  cm^  allowing  6,400  tips  underneath  each  sled.  The  sled  travels  at  10  mm/s  during 
media  access  but  is  not  restricted  to  that  speed  during  seeks.  Although  these  numbers 
appear  to  yield  a  capacity  of  2.98  GiB  per  sled,  the  capacity  decreases  because  of  two 
factors.  Error  detection  and  correction  from  the  media  demands  a  10-bit-per-byte  encoding. 
Also,  sled  tracking  and  synchronization  information  on  the  media  introduces  approximately 
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11%  overhead— about  10  bits  every  80  data  bits.  This  yields  an  effective  capacity  of  about 
2.098  GiB  per  sled. 

The  “2nd  Generation  (G2)”  model.  Several  fundamental  changes  occur  in  G2.  Data 
are  encoded  in  G2  to  allows  media  access  in  either  the  positive  or  negative  Y  direction.  Also, 
we  expect  Gl’s  typewriting  scheme  to  be  replaced  by  a  Giant  Magnetoresistive  (GMR)  head 
design,  logically  similar  to  current  disk  technology,  which  allows  at  a  minimum  the  doubling 
of  the  read  speed  to  400  kbit/s  or  16  mm/s  (not  20  mm/s  because  the  bit  width  is  20achieve 
access  speeds  of  1  Mbit/s  per  tip,  but  our  initial  results  indicate  that  given  an  acceleration 
for  the  sled  of  ll.lg,  a  point  of  diminishing  return  is  quickly  reached  where  the  gains  of 
faster  media  access  are  negated  by  the  excess  time  needed  to  accelerate  the  sled  to  speed. 
G2  also  increases  the  bit  density  by  20%,  reflecting  trends  in  magnetic  materials. 

The  “3rd  Generation  (G3)”  model  approaches  the  high  end  of  many  of  the  MEMS 
parameters  and  characteristics.  Although  somewhat  speculative,  we  believe  many  of  these 
are  achievable  given  an  applied  long-term  MEMS  research  and  development  program.  G3 
anticipates  a  decreased  sled  mass  providing  a  better  resonant  frequency  for  the  sled  as  well 
as  a  higher  acceleration  drive,  both  of  which  improve  the  sled  seek  time.  G3  also  increases 
the  resolution  of  the  tips  and  positioning  system  to  a  30  nm  bit  width,  decreasing  the  sled 
access  speed  by  25%  and  increasing  the  overall  capacity  to  over  5.8  GiB/sled!  Access  speed 
in  Table  1  decreases  because  the  smaller  bit  width  drops  the  baseline  read  speed  to  3  mm/s 

and  we  continue  to  use  400  kbit/s  tip  access  times. 

The  reference  disk.  To  compare  MEMS-based  storage  against  conventional  disk  drives 
we  used  a  Seagate  Technologies  Cheetah  4LP  ST-34501  W.  Representative  parameters  for  the 
Gheetah  4LP  are  provided  in  Table  2.  Although  originally  introduced  in  1997,  the  Cheetah 
4LP  is  still  considered  one  of  the  high-end,  high-performance  disk  drives  available  today. 
We  are  fortunate  to  have  access  to  a  validated  DiskSim  module  for  the  Cheetah  4LP  [15], 
this  enables  us  to  execute  a  direct  comparison  of  Cheetah  performance  to  MEMS  device 
performance. 

The  SuperDisk  model  was  created  to  compare  MEMS-based  storage  to  an  aggressive 
disk  drive  projection  to  the  year  2005.  Extrapolating  on  the  current  performance  trends  in 
disk  drive  technology,  our  SuperDisk  achieves  streaming  bandwidth  of  up  to  100  MB/second. 
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Cheetah 

“SuperDisk” 

RPM 

10,033 

14,400 

sectors  per  track 

130-194 

520-776 

data  surfaces 

8 

2 

average  latency 

2.99  ms 

2.08  ms 

average  rotational  seek  (read/ write) 

7.7  ms/8.7  ms 

5.0  ms/5.0  ms 

max  full  stroke 

18.2  ms/19.2  ms 

10.6  ms/10.6  ms 

Table  2:  A  comparison  of  the  Seagate  Cheetah  41'P  ST-34501W  disk  drive  and  the 
extrapolated  SuperDisk  model.  Specifications  for  the  Cheetah  4LP  are  from  [16,  15]. 

Its  seek  time  drops  by  40%  (i.e.,  7%  per  year)  to  a  5  ms  average  and  rotates  at  14,400  RPM. 
The  Cheetah  and  SuperDisk  parameters  are  compared  in  Table  2. 

3  Performance  of  MEMS-Based  Storage  Devices 

This  section  overviews  how  we  model  the  performance  of  MEMS-based  storage  devices.  Be¬ 
cause  these  devices  are  in  their  infancy,  our  simulation  model’s  timings  are  derived  from 
extensive  discussions  with  researchers  who  are  actively  developing  this  technology.  In  re¬ 
turn,  our  results  are  helping  these  researchers  refine  their  designs  by  identifying  system-level 
problem  areas.  A  detailed  description  of  our  performance  model  for  MEMS  based  storage 
and  an  exploration  of  its  performance  sensitivity  to  various  design  parameters  and  “disk” 
scheduling  algorithms  are  presented  in  [8]. 

We  integrated  our  simulation  module  for  MEMS-based  storage  into  DiskSim.  DiskSim  is 
a  freely-available  disk  simulator  that  has  been  proven  to  very  accurately  model  disk  drives  [5], 
including  the  Seagate  Cheetah  used  as  a  baseline  in  this  paper.  DiskSim  also  includes  a  syn¬ 
thetic  I/O  workload  generation  module,  which  we  used  for  the  microbenchmark  experiments 
in  Section  3.2. 

3.1  A  Model  of  MEMS-Based  Storage  Performance 

The  set  of  bits  that  can  be  accessed  by  a  given  probe  tip  are  arranged  in  a  square,  and  each 
can  be  identified  by  its  <x,y>  coordinates.  Bits  are  read  by  moving  the  media  sled  over  the 
tips  in  the  Y  dimension  at  the  access  velocity,  which  is  determined  by  the  bit  width  and  the 
rate  at  which  a  tip  can  read  or  write  bits.  To  allow  a  tip  to  access  a  set  of  bits,  the  media 
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sled  must  first  seek  to  the  proper  <x,y>  location.  Then,  to  complete  an  access,  the  sled 
must  slide  past  the  active  tips  until  all  desired  data  are  transferred.  Thus,  the  access  time 
for  a  given  request  is  the  sum  of  the  seek  time  and  the  transfer  time. 

Because  separate  actuators  are  used  for  the  X  and  Y  movements,  they  are  independent 
and  the  time  required  for  a  given  seek  is  the  maximum  of  the  two.  The  model  keeps  track 
of  the  sled’s  position  and  velocity,  and  first-order  mechanics  provide  timings  for  X  and  Y 
seeks.  For  example. 


because  an  X  seek  starts  at  rest,  accelerates  at  full  speed  for  half  the  seek  distance,  decelerates 
at  full  speed  for  half  the  seek  distance,  and  comes  to  rest  at  the  destination  column  of  media 
bits,  tsettie  represents  the  time  required  for  oscillation  of  the  spring-mounted  sled  to  damp 
enough  for  the  probe  tip  to  function;  it  is  dependent  mainly  on  the  resonant  frequency  of 
the  sled.  A  similar  equation  is  used  for  seeks  in  the  Y  dimension. 

Requests  arriving  at  a  MEMS  device  are  addressed  to  512  byte  logical  block  numbers 
(LBNs)  as  in  SCSI.  A  mapping  function  translates  LBNs  to  physical  sled  positions.  In  our 
model,  LBNs  of  512  bytes  are  striped  across  64  concurrently  active  tips,  which  represents 
a  subset  of  the  total  number  of  concurrently  active  tips  at  any  point  during  a  transfer. 
Combined  with  the  servo  and  encoding  overheads,  90  bits  per  tip  must  be  read  in  order  to 
read  a  full  logical  block.  Thus,  in  the  time  required  to  read  90  bits,  many  logical  blocks  can 
be  read  (e.g.,  10,  if  640  tips  can  be  concurrently  active).  Sequential  logical  blocks  are  placed 
at  ascending  <x,y>  starting  positions,  filling  each  column  of  concurrently  active  tips  before 
moving  to  the  next.  Thus,  for  multi-sled  devices,  the  blocks  of  a  single  address  space  are 
striped  across  the  sleds  using  the  maximum  possible  stripe  unit  size  (the  capacity  of  a  single 
sled) . 


3.2  Microbenchmark  Results 

To  understand  the  base  performance  of  a  MEMS-based  storage  device,  we  measured  its 
performance  on  a  set  of  10,000  random  requests.  Two  thirds  of  the  requests  were  reads, 
and  the  arrival  rate  was  20  requests  per  second.  Figure  5  shows  that  the  performance  of  all 
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Figure  5:  Average  total  response  times  of  each  model  under  the  microbenchmark.  Inter¬ 
esting  features  to  note  are  the  overall  better  performance  from  the  MEMS  devices  and  their  smaller 
variances. 


three  MEMS  models  beat  that  of  the  Cheetah  and  SuperDisk  disks  by  almost  3x  and  2x, 
respectively. 

Figure  5  also  shows  that  the  MEMS  devices  have  much  less  access  time  variation  than 
disk  drives.  In  a  disk  drive,  the  maximum  distances  over  which  the  heads  and  media  must 
travel  to  reach  an  individual  block  vary  quite  a  bit,  causing  the  wide  variation  in  access 
time.  In  this  experiment,  the  coefficients  of  variation  (^)  for  the  Cheetah  and  SuperDisk 
access  times  are  0.76  and  0.79,  respectively.  In  contrast,  the  MEMS-based  storage  devices 
have  coefficients  of  variation  between  0.18  and  0.20.  This  is  due  equally  to  the  absence  of 
rotational  latency  and  the  fact  that  a  full  throw  of  the  media  is  on  the  order  of  tens  of  microns 
as  compared  to  centimeters  in  a  disk  drive.  Therefore,  seeks  times  are  tightly  constrained. 
The  lower  variances,  and  thus  greater  potential  predictability,  has  intriguing  consequences 
for  the  design  of  embedded  systems  with  both  storage  and  real-time  requirements. 

Another  characteristic,  which  we  do  not  show  in  this  graph,  is  the  benefit  of  parallelism. 
A  MEMS-based  storage  device  can  easily  consist  of  multiple  fully-independent  sleds  over 
which  data  are  striped.  A  conventional  disk  queues  incoming  requests  when  the  device 
is  already  servicing  a  previous  request,  because  there  is  only  one  mechanism  for  accessing 
the  media.  However,  a  multi-sled  MEMS-based  storage  device  can  simultaneously  service 
multiple  separate  requests  if  their  data  falls  on  separate  sleds,  much  like  disk  arrays.  To 
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quantify  the  benefit  of  parallelism,  we  increased  the  arrival  rate  and  compared  a  4-sled 
model  with  the  single-sled  model  -  as  expected,  the  4-sled  device  provides  4  times  the 
throughput  for  this  random  workload.  We  continue  to  characterize  the  device  s  parallelism 
characteristics,  but  early  results  indicate  that  inter-sled  stripe  unit  trade-offs  conform  to  the 
expectations  given  by  earlier  disk  striping  work  [13,  3].  In  addition,  similar  benefits  can  be 
gained  by  aggregating  multiple  single-sled  devices  together,  as  in  a  RAID  system.  Given  the 
significantly  lower  volume  of  MEMS-based  storage  devices,  many  independent  sleds  could 
be  fit  into  a  standard  drive  enclosure,  increasing  both  the  performance  and  the  capacity  per 
volume  relative  to  conventional  disks. 

4  Application  results 

To  successfully  fill  the  memory/storage  gap,  MEMS-based  technology  must  offer  a  significant 
improvement  in  I/O  and  overall  application  performance.  Using  six  different  applications, 
this  section  compares  the  performance  of  our  MEMS-based  storage  device  models  (Gl,  G2, 
and  G3)  against  a  1997  Seagate  Cheetah  disk  drive  and  our  hypothetical  SuperDisk. 

4.1  Simulation  Environment 

To  explore  the  impact  of  MEMS-based  storage  devices  on  real  application  performance, 
we  incorporated  our  modified  version  of  DiskSim  into  SimOS  (see  Figure  6).  SimOS  is  a 
complete  machine  simulator,  capable  of  booting  real  operating  systems  and  running  real 
applications  [14].  SimOS  was  configured  to  model  a  500  MHz  21164-based  system  (128 
MB  RAM)  running  Digital  UNIX.^  The  OS  runs  atop  the  virtual  machine,  using  special 
device  drivers  to  interact  with  simulated  I/O  devices.  We  incorporated  DiskSim  into  SimOS, 
replacing  its  default  disk  model.  For  each  of  our  experiments,  we  varied  only  the  storage 
device,  fixing  all  other  variables. 

1  It  is  important  to  note  that  a  fairer  comparison  would  scale  the  processor  architecture.  We  are  currently 
modifying  our  simulation  environment  to  support  the  processor  architecture  we  anticipate  m  2005.  this 
change  should  significantly  improve  the  user  and  system  CPU  time,  increasing  the  relative  importance  o 
I/O  by  making  I/O  performance  a  much  larger  percentage  of  each  application’s  run  time. 
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Figure  6:  Our  simulation  environment.  The  MEMS  device  model  integrates  with  the  DiskSim 
subsystem  simulator  to  provide  the  storage  component  of  the  SimOS  machine  simulator.  DiskSim 
can  simulate  either  storage  model  (disk  or  MEMS  device)  or  both  models  simultaneously. 

4.2  Results 

Our  first  two  applications,  the  Andrew  Benchmark  Suite  [7]  and  PostMark  [9]  were  designed 
for  file  system  and  I/O  performance  analysis.  The  Andrew  Benchmark  consists  of  a  set  of 
file  and  directory  operations  followed  by  a  long  compile.  The  PostMark  benchmark  performs 
many  small  file  operations  (e.g.,  create,  delete,  read,  write)  and  was  designed  to  be  represen¬ 
tative  of  the  file  system  workloads  seen  in  e-mail,  news,  and  web  commerce  environments. 
Figures  7  and  8  show  that  MEMS-based  storage  devices  can  largely  eliminate  the  1/ 0  wait 
times  for  these  workloads.  For  Andrew,  the  G2  MEMS-based  storage  device  provides  a 
modest  2%  additional  reduction  in  I/O  wait  time  beyond  the  first.  The  improvement  is  due 
to  the  G2  model’s  ability  to  access  data  as  the  sled  moves  in  either  Y-direction  (i.e.,  up  or 
down). 

The  data  for  PostMark  (Figure  8)  shows  a  dramatic  benefit  for  MEMS-based  storage 
devices  even  when  compared  to  the  SuperDisk.  This  impressive  improvement  comes  from  a 
fundamental  physical  difference  in  how  MEMS-based  storage  accesses  data.  Specifically,  the 
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frequent  create  and  delete  operations  in  PostMark  cause  repeated  synchronous  writes  to  file 
system  metadata,  forcing  the  storage  devices  to  make  same  sector,  back-to-back  updates.  For 
a  conventional  disk,  such  back-to-back  same-sector  accesses  require  a  full  rotation  (typically 
6-8  ms  on  today’s  disks)  between  updates.  This  explains  why  PostMark  spends  much  of 
its  I/O  time  waiting  for  full  disk  rotations.  MEMS-based  storage  does  not  involve  rotating 
platters,  and  so  the  MEMS  models  do  not  suffer  from  these  full  rotation  latencies  for  back- 
to-back  rewrites.  Specifically,  MEMS-based  storage  can  write  a  sector,  immediately  reverse 
direction  and  then  rewrite  the  sector  in  0.3  ms.  This  physical  difference  gives  MEMS-based 
storage  a  fundamental  performance  advantage  over  rotating  media  for  this  access  pattern. 
While  this  specific  problem  could  be  significantly  reduced  with  a  small  amount  of  write-back 
caching  (either  in  the  file  system  or  at  the  disk),  similar  behavior  is  exhibited  by  many 
read-modify-write  activities,  such  as  transaction  processing  and  RAID  parity  updates. 

The  next  set  of  benchmarks,  GNULD  and  the  TPC-D  queries  also  show  significant  perfor¬ 
mance  improvements  for  MEMS-based  storage.  However,  Figure  9  shows  that  the  Super  Disk 
outperforms  the  Gl  MEMS-device  for  TPC-D  query  4,  because  SuperDisk’s  higher  streaming 
bandwidth  more  than  compensates  for  the  higher  access  times  for  this  data  mining  query. 
However,  a  disk  drive’s  streaming  bandwidth  varies  by  ~40%,  depending  on  the  location  of 
the  data  (i.e.,  outer  vs.  inner  tracks).  For  these  experiments,  all  of  the  data  is  located  on  the 
disk’s  outer  tracks,  making  the  performance  best-case.  In  contrast,  MEMS  devices  do  not 
have  any  variation  in  streaming  bandwidth  (for  contiguous  data).  Therefore,  if  the  data  had 
resided  on  SuperDisk’s  inner  (i.e.,  slower)  tracks,  SuperDisk  would  have  seen  performance 
much  closer  to  the  Gl  MEMS-device.  With  its  increased  bandwidth,  the  G2  MEMS  device  s 
lower  access  times  allow  it  to  outperform  the  SuperDisk. 

The  results  for  TPC-D  query  6,  shown  in  Figure  10,  show  the  expected  result  for  work¬ 
loads  that  are  CPU-bound  rather  than  I/O-bound  —  eliminating  the  I/O  stall  time  provides 
only  a  modest  8%  decrease  in  overall  runtime.  As  CPU  speeds  continue  to  increase  relative 
to  disk  speeds,  of  course,  the  importance  of  I/O  increases. 

For  several  of  the  benchmarks,  CPU  time  decreases  slightly  with  the  better-performing 
MEMS  devices.  All  of  these  decreases  are  in  the  system  time  charged  to  the  application.  The 
reason  for  the  decrease  is  that  shorter  runs  times  reduce  the  amount  of  time  an  application 
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Figure  7:  Runtime  for  the  Andrew  Benchmark. 
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Figure  8:  Runtime  for  the  PostMark  Benchmark. 


can  be  charged  for  general  system  overhead,  such  as  I/O  interrupt  handling.  Therefore, 
system  time  will  generally  decrease  by  a  modest  amount  when  applications  complete  in  less 
time. 


5  Potential  of  MEMS  Storage  and  Computation 

MEMS-based  storage  devices  fill  a  growing  hole  in  the  classical  memory  hierarchy.  Their  I/O 
performance  can  be  an  order  of  magnitude  better  than  disk  drives  and  their  physical  char¬ 
acteristics  provide  some  fundamental  performance  advantages  that  rotating  media  cannot 
compete  against.  Other  advantages,  such  as  their  physical  size,  portability,  and  the  poten¬ 
tial  to  integrate  processing  within  the  same  substrate,  create  many  exciting  possibilities  for 
system  architects. 
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Figure  9:  Runtime  for  TPC-D  Query  #4- 


Figure  10:  Runtime  for  TPC-D  Query  #6. 
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As  we  have  explored  here,  MEMS-based  storage  could  be  an  attractive  alternative  to 
disk.  Cost,  however,  is  often  the  judge  of  a  technology.  MEMS-based  storage  creates  a  new 
low-cost  entry  point  for  modest-capacity  applications  of  1-10  GB.  This  is  because  disks’ 
assemblies  of  mechanical  components  keep  manufacturing  costs  from  falling  below  a  certain 
point,  while  MEMS-based  storage  rides  the  linear  decline  in  IC  manufacturing  process  costs. 
However,  drives  enjoy  a  lOx  price  advantage  for  high-capacity  storage  {e.g.,  50  GB  in  1999) 
because  the  drive  assembly  costs  are  subsumed  by  the  media  cost. 

For  many  “portable”  applications  such  as  notebook  PCs,  PDAs,  and  video  camcorders, 
MEMS-based  storage  also  provides  a  more  robust  and  lower  power  solution.  Unlike  rotating 
storage,  which  cannot  cope  with  device  rotation  (e.g.,  rapidly  turning  a  PDA)  and  is  very 
sensitive  to  shock  (e.g.,  dropping  a  device),  MEMS-based  storage  does  not  suffer  any  gyro¬ 
scopic  effects  and  can  absorb  much  greater  external  forces.  Further,  while  MEMS-based  and 
disk  storage  consume  approximately  the  same  power  per  Megabyte  when  data  is  accessed, 
MEMS  has  much  more  agile  standby  and  wakeup  capability.  Therefore,  MEMS-based  stor¬ 
age  can  rapidly  switch  between  sleep  and  active  mode,  avoiding  long  and  power-hungry 
spin-up  cycles. 

MEMS-based  storage  also  represents  a  non-volatile  addition  to  the  storage  hierarchy.  For 
example,  with  their  low-cost  entry  point,  MEMS-based  storage  devices  could  be  incorporated 
into  future  disk  drives  as  a  very  large  (1-lOGB)  non-volatile  MEMS  cache.  With  their 
superior  performance,  the  MEMS  cache  could  absorb  latency-critical  synchronous  writes  to 
metadata  and  cache  small  files  to  improve  small  read  performance.  Further,  if  the  MEMS- 
based  storage  device  is  exposed  to  the  OS,  file  systems  could  deliberately  allocate  specific 
data  onto  it,  depending  on  their  access  patterns  and  performance  needs.  For  example,  file 
systems  could  place  small  structures  (e.g.,  file  system  metadata)  on  MEMS-based  storage, 
while  using  the  disk  platters  for  large  contiguous  or  infrequently  accessed  data.  In  [1],  Baker 
et  al.  show  that  using  fast  non-volatile  storage  to  absorb  synchronous  disk  writes  both  at  a 
client  and  at  a  file  server  increases  performance  from  20%  to  90%.  Although  the  systems  in  [1] 
required  only  a  small  amount  of  non-volatile  storage,  we  postulate  that  as  file  servers  grow 
to  terabyte  size  and  network  bandwidth  continues  to  increase,  larger  amounts  of  non-volatile 
storage  could  provide  further  increases  in  performance.  For  these  same  reasons,  RAID  arrays 
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would  also  benefit  from  MEMS-based  storage,  creating  AutoRAID-like  systems  [17].  Further, 
because  RAID  arrays  are  less  cost-sensitive  than  individual  disks,  arrays  of  MEMS-devices 
could  be  incorporated  more  cost-effectively. 

Another  application  domain  for  MEMS-based  storage  is  as  bulk  non-volatile  storage  for 
embedded  computers.  Single-chip  “throw-away”  devices  that  store  very  large  datasets  can 
be  built  for  such  applications  as  civil  infrastructure  monitoring  {e.g.,  bridges,  walls,  road¬ 
ways),  weather  or  seismic  tracking,  and  medical  applications.  For  example,  one  forthcoming 
application  is  temporary  storage  for  microsatellites  in  very  low  earth  orbit.  Given  that  a 
satellite  in  a  very  low  orbit  moves  very  quickly,  communications  are  only  possible  m  very 
short  bursts.  Therefore,  a  low-volume,  high-capacity,  non-volatile  storage  device  to  buffer 
data  is  required.  MEMS-based  storage  devices  could  also  add  huge  databases  to  single-chip 
continuous  speech  recognition  systems  and  be  integrated  into  low-cost  consumer  or  mobile 
devices.  Such  chips  could  be  completely  self-contained,  with  hundreds  of  megabytes  of  speech 
data,  custom  recognition  hardware,  and  only  minimal  connections  for  power  and  I/O. 

Another  compelling  opportunity  presented  by  MEMS-based  storage  is  near-absolute  data 
security.  With  true  systems-on-a-chip,  sensitive  data  never  has  to  move  beyond  the  processor 
and  the  on-chip  data  store  without  being  properly  encrypted  via  on-chip  circuitry.  Such  a 
design  would  provide  no  opportunity  for  traffic  snooping  devices,  even  if  on  the  storage 
network,  to  capture  a  cleartext  copy  of  sensitive  information.  Further,  the  self-contained 
nature  of  these  components  allow  for  the  construction  of  inexpensive,  high-capacity,  tamper¬ 
proof  smart  cards. 

6  Conclusions 

MEMS-based  storage  has  the  potential  to  fill  the  ever-growing  gap  between  RAM  and  disk 
access  times.  This  paper  describes  MEMS-based  storage,  evaluates  the  impact  of  some 
emerging  designs  on  the  performance  of  real  applications,  and  discusses  a  number  of  in¬ 
teresting  architectural  uses  for  MEMS-based  storage  in  systems.  Our  results  indicate  that 
MEMS-based  storage  can  reduce  I/O  stall  times  by  80-99%,  reducing  overall  runtimes  by 
10-2000%,  which  suggests  a  very  promising  future  for  this  technology.  Looking  ahead,  our 
ongoing  work  includes  explorations  of  how  to  restructure  storage  systems  (hardware  and 
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software)  to  best  exploit  MEMS-based  storage  devices  and  of  new  applications  enabled  by 

this  new  technology. 
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barbecue  sauce. 

Here  is  the  recipe  for  KGB’s  $100  sandwich,  along 
with  the  price  per  ingredient.  Don’t  try  this  at  home. 

Peanut  butter 
Pickled  tomato 
Minced  garlic 
Parmesan  cheese 
Cough  drops 
Chili  powder 
Miracle  Whip 
Dan’s  Breakfast 
Ginger 
Potato  flakes 
Wasabi 
Honey 

Cinnamon  Altoids 

Hearty  Beef  Gravy  w/  Pieces  of  Beef 
Green  Border  Sauce 
Sauerkraut 
BBQ  Sauce 
Curry  powder 

Dave’s  Insanity  Sauce  +  lemon  juice 
Nutmeg 

Jalapeno  peppeers  + 

Spearmint  + 

Soy  sauce  + 

Goldfish  + 


HAIKU  TO  PAIN  AND  TORTURE 

a  magic  sandwich 
spread  with  healthy  elixirs 
tummy  feels  funny 

Hero  of  the  Revolution,  Kirstin  Connors 

Noble  Grandpa  J 
Commissions  a  new  sandwich. 

Lord,  what  hath  we  wrought? 

Dining  Services 
mustn't  ever  get  their  hands 
on  this  recipe. 

Garlic  and  oatmeal, 
with  Dave’s  Insanity  Sauce. 

Cough  drops?  Sure,  why  not? 

Topping  pile  on. 

Must  Grandpa  suffer  alone? 

I  can't  let  this  fly. 

Sandwich  meets  my  tongue; 

Too  much  pain!  I  close  my  eyes 
and  think  of  England, 

Swallow.  No  more  pain! 

Hours  later,  bowels  move. 

Oh,  how  wrong  I  was! ! 

Hundred-dollar  meal, 
irreparable  damage. 

Can’t  taste  milk  no  more. 

Hero  of  the  Revolution,  Cort  Danger  Stratton 


$0.50 

2.00 

3.00 

1.00 

4.00 

2.00 

1.00 

2.00 

3.00 

5.00 

5.00 

4.00 

2,00 

10.00 

2.00 

5,00 

5.00 

4.00 

20.00 

3.00 


Vanilla _ 16.50 _ Continued  on  Page  2,.. PAIN  AND  FUNDRAISING 

KGB  GENERAL  MEETINGS  -  MONDAYS  4:30  MM  103 

You  never  know  what  Grandpa  is  going  to  do  next.  Come  to  meetings  to  watch  the  macho  insanity  build  to  a  frenzy. 


Continued  from  Page  l...$100  Sandwich 

PAIN  AND  FUNDRAISING 


Sandwich,  bite,  bite,  chew. 

This  is  not  so  bad,  I  think, 
eww,  peanut  butter. 

What  is  this  new  taste? 

Barbeque  sauce,  I  do  believe, 
eww,  Cheddar  goldfish. 

Just  chew  and  swallow, 
like  a  chick  in  a  porno, 
eww,  miracle  whip. 

Now  give  me  the  Coke. 

I  think  of  my  happy  place, 
eww,  melted  tongue  flesh. 

Hero  of  the  Revolution,  President  Chuck  Werner 

Jason  can’t  write  a 
Haiku  right  now.  He’s  still  out 
Sand-blasting  his  tongue. 

I’d  asked  a  friend  to 
Write  an  obituary. 

You  know.  Just  in  case, 

I  brought  the  honey. 

Will  Insurance  company 
Think  it’s  a  set  up? 

Does  he  suspect  me? 

The  sandwich  was  his  idea! 

He  must  know  that  I’ll... 

Just  use  it  as  an 
Excuse  to  get  submissions 
For  this  month’s  Pravda? 

(Still  one  Haiku  short! 

Damn  the  lack  of  syllables! 

I’ll  write  one  myself.) 

Karen  Adams 

PREPARED  OBITUARY.../iV  THE 
EVENT  THE  $100  SANDWICH  IS  FA  TAL 

Organizer  of  the  Revolution,  Dan  Hook 
Jason  Wolfson  passed  away  recently  in  a  tragic 
act  of  what  officials  have  deemed  "death  by  pseudo¬ 
sandwich".  Wolfson  was  28  and  leaves  behind  his 
fiancee  Karen  Adams  and  a  machine  that  goes  ping. 
Burial  will  not  occur  and  visitation  is  not  possible 
since  after  eating  the  sandwich,  the  sandwich 
proceeded  to  eat  Jason  from  the  inside,  leaving  nothing 
behind  and  violating  several  laws  of  physics.  As  the 
machine  that  goes  ping  was  not  yet  attached  to  the 
network,  condolences  will  have  to  be  sent  through 
Karen. 


Jason  ate  some  crap. 

Not  me  —  the  other  Jason. 

Hope  this  sets  things  straight. 

What  a  gross  sandwich. 

I  can't  believe  he  ate  it. 

He  must  have  some  gas. 

Peanut  butter  was 
Just  50  cents  for  a  smear. 

What  a  lame  topping. 

Pickled  tomato 
Really  hot  Indian  stuff 
That's  pretty  damn  weird. 

Chopped  minced  garlic  for  Jay, 

He  won’t  get  killed  by  vampires. 

Way  to  go,  Jason! 

Fine  Parmesan  cheese. 

Poured  from  a  can  out  onto 
The  ugly  sandwich. 

Cough  drops  with  menthol 
Feel  the  vapor  action  on 
His  poor  stuffy  head. 

Then  donations  for 
Oatmeal,  Dan’s  Breakfast,  Swiss  Miss 
Poured  in  from  the  crowd. 

Miracle  Whip  ain’t 
As  good  as  mayo  to  Jay, 

But  he  ate  it  too. 

Potato  flakes  from 
Amish  country  where  they  have 
Supermarkets  now? 

Wasabi  is  for 
Sushi  topping  in  Japan 
And  sickening  men. 

Honey  was  added 
But  Jason’s  diabetic. 

So  maybe  he'll  die. 

Cinnamon  Altoids, 

The  curiously  strong  mints, 
Freshened  Jason’s  breath. 

Hearty  beef  gravy: 

Ten  bucks  —  barf  territory! 

This  kicks  major  ass. 

Lemon  Juice  mixed  with 
Dave's  Insanity  Sauce  brought 
TWENTY  FREAKING  BUCKS! 

Jason  Weill 


In  a  Minute... Fro/w  the  Super  Secret 
Hidden  Files  of  the  Recording  Secretary! 

The  following  were  approved  for  partial  release  by  M 
DeLap.  This  does  not  imply  endorsement  of  the 
projects  or  products  shown,  and  especially  does  not 
mean  we  understand  any  of  this  drivel 

2/8/99  Motion  to  make  Kremsparc  committee  passes. 
(Wait,  that's  actually  a  useful  committee.) 
Motion  to  make  fake-Krem spare  committee 
also  passes. 

2/18/99Exec  Like  all  members  of  KGB,  they  suck  half 
the  time,  -zeleny 
Motion  for  Jason  to  shut  up  fails. 

2/22/99  "Marilyn  puts  2  liters  of  puppies  in  one 
basket." 

3/15/99  Thanks  for  making  Carnegie  Mellon  Housing 
Services  part  of  your  future  in  bed.  -zeleny 
If  you  want  to  work  on  booth,  tell  us,  or  we 
won't  even  look  for  you  because  we'll  be  in  a 
blind  rage  of  screwing.  (Chuck  &  John  Eric) 
Motion  to  close  the  Canada  committee. 

Motion  to  clothe  the  Canada  committee. 
(They  both  fail.) 

3/18/99Exec  Bite  me,  you  poophead.  -Chuck 

"My  friend  got  lucky,  but  it  was  an  accident." 
(Booth  report)  Chuck  and  John  Meier  will  be 
screwing  and  playing  DnD  at  the  same  time. 

4/l/99Exec  She  has  her  permission  to  beat  her  ass.  - 
Chuck 

4/5/99  If  you  rip  their  arms  off  they  don't  have 
shoulders  any  more,  -zeleny 

4/8/99Exec  "We  need  a  fellowship  of  Chuck's  pants,  to 
promote  the  spirit  of  Chuck’s  pants." 

"It  could  be  the  same  one  with  a  different  ear 
on  it." 

4/12/99  zeleny  nominates  a  voice-controlled  computer 
for  Rec  Sec. 

timebomb  declines  due  to  evil  look  from  Rec 
Sec. 

fortune:  "Nobody  does  it  better  than  you." 

4/19/99  The  crowbar  is  an  opiate  of  the  masses,  after 
it's  applied  to  them,  -grosman 
Exec  recognizes  the  elections  to  be  a  llama. 
No,  a  duck. 

4/27/99  Jason  Grosman  moves  to  allocate  all  of  KGB's 
money  to  himself  Motion  fails. 


EDITOR  DETERMINED  TO  GET 
2  PAGES  OUT  OF  THIS  PRAVDA? 

Karen  Adams,  the  Editor  of  Pravda?,  so  named 
because  I  edit  this  document.  You  do  not  edit  Pravda? 
and  so  to  call  you  the  editor  would  be  incorrect.  It  is 
only  correct  to  call  one  person  the  Editor,  and  that  is 
me.  I  am  Karen.  I  am  the  one  who  edits  the  words 
which  are  written  on  these  pages,  and  that  makes  me 
the  Editor! 

Every  now  and  then  a  Pravda?  comes  along 
that  isn’t  quite  long  enough  to  be  four  pages.  Well, 
usually,  it  isn’t  even  long  enough  to  be  two  pages,  but 
that’s  why  Dan  Hook,  Chris  Clark,  and  Cort  Stratton 
are  so  damned  cool.  Anyway,  here  is  some  filler. . . 

www.chuck.org 

I  am  Chuck  Girard,  one  of  the  first  Contemporary 
Christian  music  artists,  and  former  member  of  the 
pioneering  Christian  group,  Love  Song.  Some  of  you 
will  know  me  from  the  past,  others  will  not.  I  have 
been  in  ministry  for  25  years,  and  continue  to  travel 
throughout  the  world,  in  a  variety  of  ministry  roles . 

www.john.org 

Who  is  this  guy? 

What  kind  of  guy  is  he? 

How  did  he  get  here? 

Let  me  try  to  explain: 

I  remember  very  little  about  my  early  childhood, 
although  my  diverse  and  nearly  complete  knowledge 
of  inane  late-seventies  sitcoms  can  only  indicate  some 
form  of  serious  childhood  neglect,  if  not  abuse. 

www.margaret.com 

IT  IS  ABSOLUTELY  FORBIDDEN 
FOR  THOSE  UNDER  1 8  TO  VIEW  THIS  SITE! ! 

IF  YOU  ARE  EASILY  OFFENDED . LEAVE 

NOW!! 

www.karen.org 

The  Karens,  pronounced  (Ka-rans),  are  an  indigenous 
people  to  the  southeast  Asian  countries  of  Thailand 
and  Burma.  To  most  people  who  are  familiar  with  the 
Karens,  Karens  are  known  for  their  colorful  traditional 
clothes  and  for  their  energetic  and  jubilant  festival 
dances.  Foremostly,  the  Karens  are  known  for  their 
hospitality  and  friendliness  which  they  readily  extend 
to  everyone. 

www.jason.com 

For  over  12  years,  Jason  Associates  Corporation  has 
built  a  reputation  on  providing  exceptional  technical 
expertise.  Jason  employees  are  recognized  nationally 
and  internationally  in  their  respective  fields.  Our 
value-added  discriminator  is  our  ability  to  provide 
beyond  state-of-the-art  solutions  to  projects. 


